Waic and Wbic Are Information Criteria for Singular Statistical Model Evaluation
نویسنده
چکیده
Many statistical models and learning machines which have hierarchical structures, hidden variables, and grammatical rules are not regular but singular statistical models. In singular models, the log likelihood function can not be approximated by any quadratic form of a parameter, resulting that conventional information criteria such as AIC, BIC, TIC or DIC can not be used for model evaluation. Recently, new information criteria, WAIC and WBIC, were proposed based on singular learning theory. They can be applicable even if a true distribution is singular for or unrealizable by a statistical model. In this paper, we introduce definitions of WAIC and WBIC and discuss their fundamental properties.
منابع مشابه
A widely applicable Bayesian information criterion
A statistical model or a learning machine is called regular if the map taking a parameter to a probability distribution is one-to-one and if its Fisher information matrix is always positive definite. If otherwise, it is called singular. In regular statistical models, the Bayes free energy, which is defined by the minus logarithm of Bayes marginal likelihood, can be asymptotically approximated b...
متن کاملPractical Bayesian model evaluation using leave-one-out cross-validation and WAIC
Leave-one-out cross-validation (LOO) and the widely applicable information criterion (WAIC) are methods for estimating pointwise out-of-sample prediction accuracy from a fitted Bayesian model using the log-likelihood evaluated at the posterior simulations of the parameter values. LOO and WAIC have various advantages over simpler estimates of predictive error such as AIC and DIC but are less use...
متن کاملBayesian Cross Validation and WAIC for Predictive Prior Design in Regular Asymptotic Theory
Prior design is one of the most important problems in both statistics and machine learning. The cross validation (CV) and the widely applicable information criterion (WAIC) are predictive measures of the Bayesian estimation, however, it has been difficult to apply them to find the optimal prior because their mathematical properties in prior evaluation have been unknown and the region of the hyp...
متن کاملWAIC and cross-validation in Stan∗
The Watanabe-Akaike information criterion (WAIC) and cross-validation are methods for estimating pointwise out-of-sample prediction accuracy from a fitted Bayesian model. WAIC is based on the series expansion of leave-one-out cross-validation (LOO), and asymptotically they are equal. With finite data, WAIC and cross-validation address different predictive questions and thus it is useful to be a...
متن کاملSustainable Energy Planning By A Group Decision Model With Entropy Weighting Method Under Interval-Valued Fuzzy Sets And Possibilistic Statistical Concepts
In this paper, a new interval-valued fuzzy multi-criteria group decision-making model is proposed to evaluate each of the energy plans with sustainable development criteria for proper energy plan selection. The purpose of this study is divided into two parts: first, it is aimed at determining the weights of evaluation criteria for sustainable energy planning and second at rating sustainable ene...
متن کامل